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Abstract 

Holographic algorithms are a recent breakthrough in computer science and has found applications in information 
theory. This paper provides a proof to the central component of holographic algorithms, namely, the Holant theorem. 
Compared with previous works, the proof appears simpler and more direct. Along the proof, we also develop a 
mathematical tool, which we call c-tensor. We expect the notion of c-tensor may be applicable over a wide range 
of analysis. 

I. Introduction 

Holographic algorithms |[I1, [l2l, 0, Hi, pioneered by L. Valiant, are a recent breakthrough in the theory 
of computation. Specifically, in his landmark paper |[ll. Valiant presented polynomial-time algorithms - 
holographic algorithms — for a number of problem families which were not known to be in P previously. 



^ Holographic algorithms have been recently introduced to the information theory community and applied 
to solving the capacity of certain constrained coding problems HSJ. 



Briefly, holographic algorithms set out to compute the sum of a multi-variate function over its con- 
figuration space where the function considered involves a large number of variables and factors as the 
product of local functions. Problems of such nature arise frequently in information theory, for example in 
computing constrained-coding capacity and in decoding various error correction codes. It is well-known 
that in general, obtaining exact solutions for such problems is computationally intractable. However, in 
the methodology of holographic algorithms, when it is possible to apply certain transformation of the 
problems, polynomial-time solvers can be constructed. Such transformations, which Valiant refers to as 
holographic reductions, form the basis of holographic algorithms. 



The central component of holographic reductions is the Holant Theorem, which was introduced and 
proved in PJ. The proof however appears rather encrypted to many audience, and subsequently inspired 
an alternative proof given by Cai and Choudhary in |l6l. As the proof of JH uses a sophisticated machinery 
of tensors that is not familiar to broad audience, here we present a more direct proof. At least to us, our 
proof seems simpler, accessible for general audience and contains more insights. Additionally, the Holant 
Theorem in this paper is proved in its most general form, namely, the variables may take values from 
arbitrary alphabet. This contrasts the previous works where only binary alphabets are considered. 

It is remarkable that our proof relies on the notion of "c-tensor", a term which we coin in this paper. 
In a sense equivalent to the standard tensor product, c-tensor differs from the standard tensor product in 
that it is a commutative operation. Using c-tensor, our proof of Holant Theorem appears more transparent. 
Although perhaps under the guise of mathematical literature, the notion of c-tensor synthesized in this 
paper appears to be a useful tool. We expect that c-tensor may find other applications in context beyond 
Holant Theorem. 

This paper is organized as follows. Section |Il] gives mathematical preliminaries, where the main focus 
is to develop the mathematical tool of c-tensor. Section [nl] states and proves Holant theorem. Section |IV] 
provides a brief conclusion. 

II. Preliminaries 

A. Assignments 

For an arbitrary finite seu E and any finite alphabet A, we refer to any function mapping E into A 
as an A-assignment on E, and collectively denote the set of all such assignments by A^ . If x is an 
^-assignment on E, we often write xe in place of x to make explicit the domain of function x. For any 
subset U '^ E, the restriction of an ^-assignment xe to U will be denoted by xe-u- That is, xe-u is an 
^-assignment on U such that for every e eU, XE:u{e) = XE{e). If E is clear from the context, we may 

'ah sets in this work are non-empty unless otlierwise specified. 



write xu in place of xe-u for simplicity. In particular, such practice will be more common when ^ is a 
singleton {e} for some e e E". In this case, we always write x^^,} rather than XE:{e}- 

With a slight abuse of notation, an assignment, say xe, is also treated as a set, namely, the set 
{{e,XE{e))\e e E} or the graph of function xe- Under such interpretation, restriction xe-u is also 
understood as set {(e,X£;(e))|e g U}. In addition, for any two disjoint finite sets Ei and E2 and any 
two ^^-assignments xe^ and xe2, the union xe^ u xe2 is well defined and can be interpreted back as an 
^-assignment on Ei u E2 defined by 



{xei ^XE2)ie) = < 



XEi{e), if e e El 
XEiie), ifeeE2 



Conversely, every >l-assignment xeiuEz on Ei u E2 can be understood as the union xe-^ u xe2 of two 
^-assignments xe-^ and xe2, which are the restrictions of xei^E2 to Ei and E2, respectively. Furthermore, 
it is easy to verify that the decomposition of any xe^^E2 in terms of the union of two such restrictions is 
unique for any fixed choice of Ei and E2. This establishes a one-to-one correspondence between the set 
j^E^^E2 Qj^ ^Y ^-assignments on Ei u E2 and the cartesian product A^'^ x A^'^. Extending this argument 
by induction (on the number of disjoint sets), we obtain the following lemma. 

Lemma 1: Let .E be a finite set and {Ei, . . . , Ep] be an arbitrary partition of E. Then for any finite alpha- 
bet A and any ^-assignment xe on E, there exists a unique sequence of restrictions xe:Ei,xe:E2i • • • j ^e-.Ep 
of xe to El, E2, . . . Ep respectively such that xe = ULi ^E-.Ei- Conversely, for any given ^-assignments 
xei,xe2i ■ ■ -Xe , the union (Jf^^^ xe^ is an ^-assignment on E. That is, there is a one-to-one correspon- 
dence between A^ and the p-fold cartesian product A^^ x A^'^ x . . . x A^^ . 

B. Space of functions 

In this paper, we will often work with vector spaces in the form of C'^, where C'^ is the set of all 
functions from a finite set S to the field of complex numbers C The following lemma, straight-forward 
to prove, justifies that the set C"^ is a vector space. 



Lemma 2: For any finite set S, let the set C'^ of all functions mapping S into C be equipped with the 
following two operations: 

. Addition: V/, /' e C^, (/ + f'){s) := f{s) + f'{s) for every seS. 

. Scalar multiplication: V/ g C'^ and a e C, (a/)(s) := a(/(s)) for every s e S. 
Then C"^ is a vector space isomorphic to Cl"^!. 

Note that from this lemma it is immediate that C'^ = C'^' whenever IS"! = \S'\ < go. In the lemma, 
the fact that C'^ = C'"^' can be established by advising an explicit vector space isomorphism. Such 
isomorphism is clearly not unique. Let r be an arbitrary set bijection from S into the set {1, . . . , ISI). It 
is not hard to show that a : C^ ^ C'"^' such that 

a{f) = {fir-\l)), f{r-\2)), ..., f{r-\\S\))) 

for all / e C"^ is a vector space isomorphism. We refer to such isomorphism as a natural one. At places 
where confusion is unlikely, we may write /r^^(-) for the composition /(r^^(-)) to enhance readability. 
Since C"^ is a vector space over C of dimension IS"], one can find a set of functions which form a basis 
in C"^. An obvious example of a basis is the "standard" one, namely, the set B^^^ = {5s : s e S} where 
for any s e S, 5s '■ S ^ C is such that 5s{x) = I if x = s and otherwise 5s{x) = for all x e S. Note 
that a natural vector space isomorphism mapping C"^ to C''^' simply accounts to taking coordinates with 
respect to B^^^ under the ordering induced by the bijection r associated with the natural isomorphism. 
More explicitly, let a : C^ ^- Cl'^l be a natural isomorphism and let r : 6" ^- {1, . . . , IS"!} be the bijection 
associated with a. Then for any / e C'^, the ith component of a{f) is the coefficient of 5r-i(i) when / 
is expressed as a linear combination of elements from the basis B^^^. Another example of basis can be 
constructed as follows. Let S = {si, . . . , s\s\} and let Si = {si, . . . , Sj} for all 1 ^ i ^ IS"]. Further let 
B = {/3i, . . . , (3\s\} where (3i : S ^- C is such that (3i{x) = 1 if x e Si and otherwise pi{x) = for all 
X e S. Then, one can easily verify that the set ;S is a basis of C'^. 



Finally, for any vector space C"^, as above, we define the map (•,•): C'^ x C"^ ^- C by 

(f,f):=J]f{x)f{x) (1) 

xeS 

for all /, /' G C'^. It is clear that the map (•, •) is bilinear. 

As we will see momentarily, vector space C'^ considered in this paper mostly takes S as A^ for some 
choice of alphabet A and finite set E. In this case, we will write C^ in place of C*^-^ ) to lighten the 
notations. 

C. c-Tensors 

Let El and E2 be two disjoint sets. For any /i g C_4^ and /2 g C_4^, we define the c-tensor /1O/2 of 
/i and /2 as the element in C;^^^^^ (that is, the function mapping ^^I'^^a jj^^q (J^-j %uc\i that for every 

{flOf2){xEiuE2) '■= fl{X{EiuE2):Ei)f2{X(EnjE2y.E2) 

Inductively, we can extend the notion of c-tensor to arbitrary number of functions /i g C;^^ , /2 g 
C^^ . . . , fp e C^, where {Ei, E2, . . . , Ep] is an arbitrary collection of disjoint finite sets. The following 
lemma is directly provable from the definition of c-tensor. 

Lemma 3: c-tensor is commutative and associative. 

Proof: Let /i g C^^, /2 g C^ and /a g C^^ where Ei, E2 and E^ are finite disjoint sets. Then, 

\flG>f2)Of3[XEiuE2uE3) = flOf2\XEiuE2uE3:EiuE2)f3[XEiuE2uE3:E3) 

= Jl{x EiuE2uE3:Ei) J2\X EiuE2uE3:E2) fzyX EiuE2uE3:E3) 
= /l [XEi uE2 uE3:Ei)j2 O/s [XEi uE2 uE3:E2uE3 ) 
= flO{f20f3){xEiuE2uE3) 



Further, 

flOf2{XEiuE2) = fl{xEiuE2:Ei)f2{XEiuE2:E2) 
= f2{xEiuE2:E2) fl{xEiuE2:Ei) 
= f20fl{XEiuE2) 

As claimed. ■ 

As will be shown momentarily, c-tensor of two functions is in a sense equivalent to the standard notion 

of tensor product of two vectors. The reason we refer to this operation "c-tensor" is to emphasize its 

commutative nature, which in general does not hold for the standard tensor product. Since the c-tensor is 

independent of bracketing and ordering (due to the previous lemma), the notation 0f_i /«, denoting the 

p— fold c-tensor of functions /i, /2, • • • , /p, is well defined. 

We now show the equivalence between c-tensor and tensor product, where standard tensor product of 

two vectors u and v is denoted by u®v. 

Lemma 4: Let Ei and E2 be disjoint and cti : C;^^ -^ Cl-^""'! and 02 ■ C^^ -^ Cl-^""'! be two natural 

vector-space isomorphisms. Then there exists a natural vector-space isomorphism a : C^^"^^^ -^ C'"^ ^" ^1 

such that a(/iO/2) = cr^{h)®cj2{h) for any h e C^' and f^ e C^\ 

Proof: Let ri : A^^ ^ {1, . . . , |^^'|} and ra : A^^ ^ {1, . . . , \A^^\} be the two bijections associated 

with (Ji and cr2, respectively. Define the set map r : ^^i^^a _^ {1, . . . , |^^^|} x {!,..., I^^^]} given by 

r{xEi^E2) = {i"i{x(Ei^E2):Ei),f2{x(^EnjE2y.E2))- Then r is a bijection since ri and r2 are bijections. Now 

define fiiCj-^^^Cl-^''^^''' I as 

a{f) = {fr-\l,l), /r-i(l,2), ..., fr-\\A''^\,\A^^\)) 
for all / G C^^^^^. Then cr is a natural isomorphism and 

a(/i0/2) = ((/i0/2)(r-^(l, 1)), (/iO/2)(r-^(l, 2)), . . . , {hQf2)ir-\\A^^\, |^^^|))) 



= (/irr^(l)/2r2-^(l), hr^\l)f2r,H2),...,hr^\l)f,r,\\A''-\), 

Arr^(|yl^^|)M-^(l), Arr^(|yl^^|)M-^(2), . . . , /irr^(|^^N)/2r2-^(|^^^|)) 

= 0-1 (/l)® 0-2 (A) 

as desired. ■ 

Extending this lemma by induction to multi-fold c-tensor gives the following corollary. 
Corollary 1: Let Ei,E2, ■ ■ ■ ,Eph& pairwise disjoint and cti : C;^^ -^ C'-^ ^1, (72 : C^^ -^ C''^ ^1, . . . , cTp : 

C^^ ^- C'-^ ''I be natural vector-space isomorphisms. Then there exists a natural vector-space isomorphism 

a-.di^^' -^e^^'^'^'l such that 



p 
a'' 



(0 f^) = ^1 (/l) ® f^2(/2) ® • • • ® ^p(/p) 
i 

for any A g C:^^ A g Cf , . . . , /, e Cj . 

This establishes a sense of equivalence between c-tensor and the standard tensor product. 

D. Basis 

Let ^ be a finite alphabet and i? be a finite set. For each e e E, define map Tg : C-^ -^ C^ such that 

for all / G C-^ 

Teif)iX{e}) = f{X{e}{e)) 



for all X{e} e A^'^K 

The following lemma shows that Tg is an isomorphism. 

Lemma 5: Let i? be a finite set and for each e e E, define Te : C"^ -^ C_4 as above. Then each Tg is 
a vector space isomorphism. 



Proof: Let / and /' be arbitrary functions from C-^ and a and a' be arbitrary scalars from C Then 
for all Xje} e A^^^ we have 



Te{af + a'f'){x{e}) = [ocf + a'f){x{e}ie)) 

= {af){x{e}{e)) + (a7')(^{e}(e)) 
= af{x^e}ie)) + a'f'(x{e}{e)) 

= aT-e(/)(X{e}) + aVe(/)(X{e}) 

Hence, Te{af + a'f) = aTe{f) + a'Te{f') and therefore Te preserves addition and scalar multiplication. 

Assume /, /' e C-^ are such that re(/) = Te{f') then re(/)(x{e}) = Te(/')(x{e}) for all x^e] e A^^K 
Hence, /(xje}(e)) = /'(2;{e}(e)) for all X{e}. This is equivalent to f{a) = f'{a) for all a g ^ and hence 
/ = /', which implies Te is injective. Surjectivity of t^ is automatic since C"^ and C^^* both have the 
same finite dimension. ■ 

By lemma [2l we know that C-^ is a vector space of dimension |^|. Let ,B be a basi^ of C-^ and for 
each e e E denote by Te{B) the image of B under Te, that is, Te{B) = {re(/3)|/3 e B}. Then Te{B) forms a 
basis in C_l for all e e i^ because an isomorphism maps basis into basis. Since each element in the basis 
Te{B) is a map from A^^^ into C, then for any ,B-assignment on E, say bs, the c-tensor QeeE'^e{bE{e)) 
is a map from A^ into C. This motivates the following definition. For any E, A and B as above, we 
define the map £ : A^ x B^ ^ C such that 



£{aE,bE) = {QTe{bE{e))){aE) 



eeE 

for all (ttE, bs) ^ A^ x B^. Note that the name of the map was chosen to emphasize that its arguments 
are assignments on E. Hence in subsequent discussions- if we write for instance £i, then we mean the 
map from A^^ x B^^ to C defined as above. 

^Our definition for a basis coincide with tlie one from linear algebra, i.e, a basis is a linearly independent spanning set. In contrast, the 
definition of a basis in Valiant's work was that of a spanning set. This work still holds if the definition of a basis was chosen to confine 
with Valiant's definition. 



Now if bE is a fixed S-assignment on E, then map £ induces, via Be, a function £^^'^^ mapping A^ to 
C: Formally, for any Be e B^ we define £"[^^1 : ^^ ^ C by £^^^\aE) = £{aE, bs) for all a^ g A^. 

Conversely, if aE is a fixed .4-assignment on E, then map £ induces, via ue, a function £[aE] niapping 
B^ to C: Formally, for any aE e A^ we define £[aE] '■ B^ ^- Chy £[a^](6£;) = £{aE, Be) for all 6^ e B^. 

Before we proceed, we need the following result from algebra 

Theorem 1: li B = {/3i, . . . ,/3fe} is a basis of C\ then {A,®. . .®/3i„|Ai, ■ ■ ■ , Pi^ e B,l ^ij ^k Vj} 
is a basis of the vector space C'^" . 

The following theorem is a recast of the previous one in the costumes of c-tensors and our frame of 
work. 

Theorem 2: If i5 = {/3i, . . . , /3|^|} is a basis of C"^, then {£^^^^ \hE e B^} is a basis of C% 
Proof: First note that {{ei}, . . . , {e|^|}} forms a partition of E of size IE"!. For each e e E, let 
Te : C-^ ^- Cj4 be an isomorphism as in lemma [5l Further, let a : C-^ ^- C'^' be a natural vector space 
isomorphism and define a^ : C^^' -^ Cl-^l as the composition cTg = a o r~^ for all e e E. Then, ag is a 
natural vector space isomorphism for all e e E. Hence, by corollary [H there exists a (natural) isomorphism 
aE-.C^^ d^""! such that for all A e C^2'\ ..., f\E\ e cj'^'^ 

\E\ 

(JEiQfi) = CTe, (/l)®...®ae|B|(/|S|) 
i=l 

Let a(B) = 0^, . . . , /3|^|} be the image of B under a, then (T(i5) is a basis of Cl-^L Let X = {£^^^^ \bE e 
B^} and Y = {A^®. . . ® ^i^, |Ai, • • • , A|b| e cr('S), 1 ^ ^j ^ |^| Vj}. Then theorem [U asserts that Y is 
a basis of Cl-^ L Hence we are done if we can show that o-e{X) = Y, since this will imply that X is a 
basis (due to the fact that an isomorphism maps basis to basis). To this end, note that 

X e X =^ X = Qre(6£;(e)), some Be e B^ 

eeE 

^x = Te,{/3i,)Q. . .0re|^|(/?i|^|), some /3i,, . . . , A,^, e S 

=^ (^e{x) = C^ei(7-ei(Ai)) ® • • • ® ^e|£| (^e|B| (A|b| )), SOmC A, , . . . , ^i,^, G B 



10 

^aE{x) = a-(Ai)® •••®o-(A|B|), some A^, . . . , /3i|^| eB 
=^ aEix) = /3ji ® . . . ® /3j|^| , some Pj„ . . . , ^j^^^ e a{B) 
=^ aE{x) e Y 

Thus, aE{X) ^ Y. Since both aE and a are bijective, it follows that \cte{X)\ = \X\ = |;Spl = |o-(i5)pl = 
\Y\. Therefore, aEiX) = Y. U 

The following definition is fundamental 

Definition 1: Let i3 be a basis for C-^ and for any / e C^ define 

. / as the uniquqj map from B^ into C satisfying for all a e A^ 

f{a) = (lS[^^) 
. / as the map from B^ into C such that for all b e B^, 

The following proposition shows that the definition of / makes sense. 

Proposition 1: For any / e C^ and any basis B of C"^, / exists and is unique. 

Proof: Theorem [21 asserts that {£^M|6 e B^} is a basis of C;|. Hence, / can be uniquely written as 
/ = X/ftegs C(,£f^^ where c;, g C for all b e B^. Let f(b) = Cb then / is a map from B^ into C and it is 
unique. Therefore, we are done if we show this / is consistent with the definition. But / = Y^beB'^ fi^)^^^^ 
implies 

f{a) = 2 mS^'Ha) = 2 mS{a,b) = J] />)£[„] (6) = </>[„]> 

b£6^ beB'^ beB'^ 

as desired. ■ 

Let El and E2 be two disjoint finite sets and assume /i e C^^ and /2 e C^. Let E = Eikj E2, then 

^If B was a spanning set, then / is defined as any function in C^ satisfying /(a) = {/, £^[a]) for all a e A^ ■ 
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for any Be e B^, we have 



</iO/2,^f'"]> = 2 {fiQf2){aE)£{aE,bE) 

= 2] (/i0/2)(a^)(0re(6^(e)))(a^) 

= Yj^l{aE:E^)f2{aE:E2){Q'^e{bE{e))QQT^{hE{e))){aE) 
aseA'^ eeSi eeE2 

= Yj h{^E-E^)f2{aE:E2){(z) ^e(&E(e))) (a&Ei) • (0 Te{hE{e))){aE:E2) 

aseA'^ eeSi 66^2 

= 2 /i(aE:Ei)(0^e(f'i=;(e)))(as:sJ ^ /2(a£:£2)(0 re(6E(e)))(ai5:i5j 



(b) 



X! /l(ai?:Si)(0T-e(&&Ei(e)))(a£;:i^J ^ /2(a&E2) ( Tg (fes:^^ (c))) (aS:^^ 

aE:Eie^^i ee^i a£.B2e^^2 eeE2 

</i,^r"^v</2,^^"^^> 



where (a) is due to lemma [U and (b) follows from the fact that bE{e) = Iie-.eX^) for all e e Ei, i = 1, 2. 
Now induction can be used to show that this holds for any disjoint sets Ei, . . . , Ep. Hence, we have the 
following proposition (the second part of the proposition can be shown using a similar argument). 

Proposition 2: Let {Ei, . . . , Ep] be an arbitrary partition of a finite set E and B be an arbitrary basis 
of C-^. Further, let /, e Cj for all i. Then for any Be e B^ 



and for any qe e Ae 









III. HOLANT THEOREM 
Let El, . . . ,Ep and E[, . . . , E[. be two arbitrary partitions of a finite set E. Further let gi e C^' for 

E' 

all 1 ^ 2 ^ p and let hi e C^' for all 1 ^ ? ^ r. The following lemma will give a proof of the Holant 
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theorem. 

Lemma 6: Let gi, . . . ,gp and hi, ... , h,. be as above. Then under any basis B of C-^, the following 
holds 



(note that the bilinear map on the left of the equality is over the domain C^ x C^ and the one on the 
right is over Cf x Cf ). 

Proof: The lemma follows via the following series of equalities: 

- 2(0 h^){^E) W{9i,£i[xE:ES) 

= 2 (O /^O(^i.)<0^.,%.]> 

m 



id) 



(d) 



2 ( f^^)i^E)Y, ( 9i){yE)£[xE]{yE) 

2 ( ^0(^i?)2] ( gi){yE)S{xE,yE) 



2 (0^^)(?/i^)S (O /^0(^i.)^f^"H^i.) 

ffl 2 (0^O(?/i.)<0/^.,^f^-^> 

'^ s (0^^)(^-) ^<^^'^^''^> 

yseB^ ls;i=Sp IsSJsCr 

ffl<0^. 0/^.> 
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where (a), (b) and (c) are due to definition of c-tensor, definition \T\ and proposition [21 respectively. 
Definitions of £,S[xe] and ^^C^^] give equalities labeled by (d). ■ 

Now we state and prove Holant theorem 

Theorem 3: Let gi, . . . ,gp and /ii, . . . , /i^ be as defined earlier. Then for any basis B of C-^, the following 
holds 






Proof: 

S fl9^ixE■.E.)Ylk(xE:E0 = J] { Q g.){xE){ Q k){xE) 

S < ^., h.) 

= < ^., hd 

= 2(0 ^0 (?/!.)( h,){yE) 

VesB^ ls:i=SP Ij^iscr 

where (a) is due to definition of c-tensor and (b) is due to Lemma |6l ■ 

IV. Conclusion 

In this paper, we provide an alternative proof of Holant theorem using a commutative notion of tensor 
product. The proof appears to be simpler and more transparent. As holographic algorithms are expected to 
demonstrate their power in many problems of information theory, we hope that this work makes this new 
family of algorithms and the notion of holographic reduction more accessible to audience in information 
theory community. 
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